Activity review for a financial and social management system

ABSTRACT

Embodiments of the invention comprise systems, computer program products, and methods for a financial and social management system that provides improved tracking and management related to how, where, when, and with whom a user enters into activities. The financial and social management system captures activity information and images from various sources of information, including but not limited to social networking accounts, e-receipts, location determination devices, and the like, and associates the activity information and images with the activities. The financial and social management system aggregates the activity information for a number of activities based on the location, user, entity, category, cost, time period, or the like and displays the aggregated activity information in an activity review interface. The financial and social management system may supplement the aggregated activity information with educational data.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of U.S.non-provisional patent application Ser. No. 14/032,653, filed Sep. 20,2013 of the same title; the content of which is also incorporated hereinby reference in its entirety.

FIELD

The present invention relates to the field of financial management toolsand social networking management tools.

BACKGROUND

Financial management systems allow for tracking transactions, whilesocial networking systems allow users to interact with other users.However, financial systems do not provide the ability to track and grouptransactions based on social networking interactions, while socialnetworking systems do not provide the ability to relate the socialnetworking interactions to transactions.

SUMMARY

The following presents a simplified summary of one or more embodimentsof the present invention, in order to provide a basic understanding ofsuch embodiments. This summary is not an extensive overview of allcontemplated embodiments, and is intended to neither identify key orcritical elements of all embodiments nor delineate the scope of any orall embodiments. Its sole purpose is to present some concepts of one ormore embodiments of the present invention in a simplified form as aprelude to the more detailed description that is presented later.

Embodiments of the invention comprise systems, computer programproducts, and methods for a financial and social management system thatprovides improved tracking and management related to how, where, when,and with whom a user enters into activities. The financial and socialmanagement system captures activity information and images from varioussources of information, including but not limited to social networkingaccounts, e-receipts, location determination devices, and the like, andassociates the activity information and images with the activities. Thefinancial and social management system aggregates the activityinformation for a number of activities based on the location, user,entity, category, cost, time period, or the like and displays theaggregated activity information in an activity review interface. Thefinancial and social management system may supplement the aggregatedactivity information with educational data.

One embodiment of the invention comprises receiving an indication toidentify and aggregate activity information for one or more activitiesover a time period; identifying the one or more activities that meet thetime period; aggregating the activity information for the one or moreactivities, wherein aggregating the activity information comprisesaggregating the activity information related to locations involved inthe one or more activities; aggregating the activity information relatedto social relationships involved in the one or more activities;aggregating the activity information related to entities involved in theone or more activities; and aggregating the activity information relatedto categories involved in the one or more activities; and displaying theaggregated activity information for the one or more activities relatedto the locations, the social relationships, the entities, and thecategories in an interface.

In further accord with an embodiment, the invention further comprisessupplementing the aggregated activity information with educationalinformation related to the one or more activities. In another embodimentof the invention, the educational information is consumption informationrelated to the one or more activities.

In yet another embodiment, the invention further comprises accessing asocial networking account of the first user; determining one or moreimages associated with the aggregated activity information for the oneor more activities; and displaying the one or more images with theaggregated activity information.

In still another embodiment of the invention, aggregating the activityinformation comprises aggregating the activity information for the oneor more activities for the locations, the social relationships, theentities, and the categories.

In further accord with an embodiment of the invention, aggregating theactivity information for the one or more activities comprisesaggregating the activity based on a time day of the one or moreactivities.

In another embodiment of the invention, identifying and aggregating theactivity information for the one or more activities over the past timeperiod comprises receiving an indication from the first user identifyingthe locations, the social relationships, the entities, and thecategories to aggregate; and receiving the time period from the firstuser over which to aggregate the activity information.

To the accomplishment the foregoing and the related ends, the one ormore embodiments comprise the features hereinafter described andparticularly pointed out in the claims. The following description andthe annexed drawings set forth certain illustrative features of the oneor more embodiments. These features are indicative, however, of but afew of the various ways in which the principles of various embodimentsmay be employed, and this description is intended to include all suchembodiments and their equivalents.

BRIEF DESCRIPTION OF THE DRAWINGS

Having thus described embodiments of the invention in general terms,reference will now be made to the accompanying drawings, which are notnecessarily drawn to scale, and wherein:

FIG. 1 illustrates a financial and social management process flow, inaccordance with one embodiment of the invention;

FIG. 2 illustrates a financial and social management overview interface,in accordance with an embodiment of the invention;

FIG. 3 illustrates an image integration process flow, in accordance withone embodiment of the invention;

FIG. 4 illustrates a tagged relationship process flow, in accordancewith one embodiment of the invention;

FIG. 5 illustrates an activity list interface, in accordance with anembodiment of the invention;

FIG. 6 illustrates an activity filter process flow, in accordance withan embodiment of the invention;

FIG. 7 illustrates an activity location interface, in accordance with anembodiment of the invention;

FIG. 8 illustrates an activity social relationship interface, inaccordance with an embodiment of the invention;

FIG. 9 illustrates a past package process flow, in accordance with anembodiment of the invention;

FIG. 10 illustrates a package overview interface, in accordance with anembodiment of the invention;

FIG. 11 illustrates a package image interface, in accordance with anembodiment of the invention;

FIG. 12 illustrates a package transaction interface, in accordance withan embodiment of the invention;

FIG. 13 illustrates a package social relationship interface, inaccordance with an embodiment of the invention;

FIG. 14 illustrates a proposed package process flow, in accordance withan embodiment of the invention;

FIG. 15 illustrates an activity history process flow, in accordance withan embodiment of the invention;

FIG. 16 illustrates an activity history interface, in accordance with anembodiment of the invention;

FIG. 17 illustrates an activity review process flow, in accordance withan embodiment of the invention;

FIG. 18 illustrates an activity review overview interface, in accordancewith an embodiment of the invention;

FIG. 19 illustrates an activity review interface, in accordance with anembodiment of the invention; and

FIG. 20 illustrates a financial and social management system, inaccordance with an embodiment of the invention.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

Embodiments of the present invention will now be described more fullyhereinafter with reference to the accompanying drawings, in which some,but not all, embodiments of the invention are shown. Indeed, theinvention may be embodied in many different forms and should not beconstrued as limited to the embodiments set forth herein; rather, theseembodiments are provided so that this disclosure will satisfy applicablelegal requirements. In the following description, for purposes ofexplanation, numerous specific details are set forth in order to providea thorough understanding of one or more embodiments. It may be evident;however, that such embodiment(s) may be practiced without these specificdetails. Like numbers refer to like elements throughout.

Generally, systems, computer program products, and methods are describedherein for a financial and social management system that providesimproved tracking and management related to how, where, when, and withwhom a user (e.g., a customer) enters into activities (e.g.,transactions for goods or services described herein as “products”, ortransfers of currency) with entities (e.g., merchants, other users, orother like entities). As described herein the term activity informationassociated with the activity is used to not only describe thetransaction (e.g., cost of the transaction, time of the transaction, orother transaction information) in which the user enters, but also otherinformation related to the transaction, such as location, socialrelationship, entity, and category information. The financial and socialmanagement system 1 may display the activity and activity information inactivity list interfaces, packaged activity interfaces, filteredactivity interfaces, activity history interfaces, activity reviewinterfaces, or other like interfaces that incorporate aspects offinancial transactions and social networking information.

The financial and social management system 1 provides the activity andactivity information in activity lists within activity list interfaces.The activity lists may include the activities (e.g., transactions) inwhich the user (e.g., customer) has entered, and associated images(e.g., photos, videos, icons, symbols, card art, check art, other art,or other like images), or any other type of digital content related tothe activities or the environment related to the activities. Theactivity list may also include tagged information, such as but notlimited to location tags indicating the location the activity, socialrelationship tags (e.g., user tags) indicating other users associatedwith the activity, entity tags indicating the entity (e.g., merchant,non-profit organization, historic site, national park, or the likeentity) associated with the activity, or category tags (e.g., productcategories such as goods, good categories, services, service categories,or the like) indicating groupings for the activities in the activitylists. The activity information and images in the activity lists maycome from various sources including social networking accounts of theusers, e-mail accounts of the users (e.g., e-mail correspondence,e-receipts, or the like), user calendars, user contact lists, websitesover the Internet (e.g., websites of the entities or for the products),or other like accounts that provide additional activity informationrelated to the activities in the activity list.

The activity list in the financial and social management system 1 mayalso include filters that allow a user to access specific views of aplurality of activities based on the activity information related tolocations, social relationships, entities, and categories, and view theactivities in filtered interfaces. The filters may provide interfaceswith interactive maps of the location of multiple transactions, socialrelationships between the user and other users present during thetransactions (e.g., users of the financial management systems, users ofthe social networking systems, other users referenced in these systems,or the like), transactions entered into with particular entities,transactions entered into based on particular categories, or otherfiltered activity information.

In addition to the activity lists the financial and social managementsystem 1 provides packages (e.g., past packages, proposed packages,group packages) that consolidate activities into groups based on timeperiod, location, categories, or the like. The past packages allow auser to consolidate activities together for a particular time period(e.g., date, date range, or the like) or location for capturingspending, budgeting, reimbursement, or other like information. The pastpackages may be utilized for trips or otherwise for grouping activitiestogether. The proposed packages may consolidate activities that haveoccurred, are pending, or may occur in the future in order to save andbudget for events, such as trips, purchases (e.g., renovating a room),or other like activities. The group packages may be proposed or pastpackages that can be shared between users in order to split purchasesrelated to activities, or otherwise budget and plan for trips orpurchases in the future with a group of two or more users.

The financial and social management system 1 also provides activityhistory interfaces for providing financial information related toactivities that have occurred in the past along with social networkinginformation or other activity information related to the activities. Thefinancial and social management system 1 automatically, or manuallybased on a customer request, provides activity, activity information,and images for past activities. For example, a user may receive anupdate every day for activities that the user had exactly a year agofrom the current day. In other examples, the user may be in a town whichthe user previously visited and the user may request to see all of thetransactions that the user made in the town in the past in order toidentify a particular restaurant, store, product, or the like. Inresponse, the activity history interface may provide all of theactivities that the user had for the particular location in the past.

The system also provides activity review interfaces that display datarelated to the activities the user participated in over a specified timeperiod in order to provide spending and budgeting information regardinghow, where, when, and with whom the user entered past transactions. Forexample, the activity review interface may illustrate statistics suchas, most expensive purchase, fast food purchases vs. upscale restaurantpurchases, locational spending across areas within a city, state,region, or the like, spending habits with particular friends, or thelike. The system may also provide customized facts related to spending,such as consumption facts based on user spending (e.g., amount of coffeebeans used based on the amount of coffee the customer drank, or thelike).

FIG. 1 illustrates a financial and social management process flow 100for the financial and social management system 1. As illustrated byblock 102 in FIG. 1 the financial and social management system 1receives an indication that a first user 4 has participated in one ormore activities. The activities may include transactions for productswith an entity, transfers of funds from other financial institutions,deposits of funds from other users (e.g. within or outside of thefinancial institution), transactions with other users, or other likeactivities. For example, the financial and social management system 1may receive an indication that a first user 4 has entered into atransaction with an entity. As described herein throughout thisspecification “receiving an indication” may include among other things,receiving an indication from a system or application internally orexternally, either automatically (e.g., when the user enters into atransaction, receives a transaction from another entity, enters alocation, a time period is met, or the like) or manually, when the usertakes a specific action (e.g., requests to view particular information,or the like).

As illustrated by block 104 the financial and social management system 1accesses various sources of information in order to determine activityinformation associated with the one or more activities. The one or moresources of information may include the traditional source of informationthat is transferred to an institution (e.g., financial institution) byan entity as a result of a transaction between the entity and a user(e.g., customer). For example, if a first user 4 enters into atransaction with an entity (e.g., a merchant) the entity providestransaction information to the institution (e.g., financial institution,or third party institution) that controls the account from which thefirst user 4 is making the transaction. The activity information fromthe entity may include for example, the price of the transaction, thename of the entity, and the time of the transaction. However, in manyinstances the transaction information does not include the location ofthe transaction, a breakdown of the goods or services (e.g., products)and associated individual costs, categories for the types of productspurchased, or the like. In some embodiments, the transaction informationmay not include the time of the transaction. Furthermore, even if thelocation is provided in the transaction information, it may not be theactual location at which the purchase was made or the location at whichthe activity will occur. For example, the first user 4 may order aproduct over the internet, and the product location may be location ofthe business not the location from which the first user 4 placed theorder. Moreover, in another example the first user 4 may purchasetickets for a show in another city, the location information transferredmay be the city in which the user made the transaction not the locationof the ultimate transaction, such as the location of the show. In someembodiments the entity and/or the institution does not have the abilityto transfer or receive information other than the total cost of thetransaction and the name of the entity. Furthermore, the name of theentity may be a holding company or other name that does not reflect thetrue entity with which the user entered into a transaction. Therefore,the various other sources of information accessed may provide additionalactivity information related to the activity (e.g., transaction).

The users (e.g., first user 4, second user 6, or the like) may allow theinstitution to access other types of activity information from varioussources of information to supplement the activity information the entitymay receive during a transaction with an entity. For example, in someembodiments the user may allow the institution (e.g., financialinstitution, third-party institution) within the financial and socialmanagement system 1 to access the user's social networking accounts toreceive additional activity information related to one or moreactivities (e.g., transactions). For example, the institution may beable to access photos, determine other users with which the user hassocial relationships through connections (e.g., friends, family,co-workers, or the like), determine locations (e.g., tagged locations,locations of photos taken or uploaded, or the like) and times at whichthe user was located during an activity, or the like. The socialnetworking accounts include, but are not limited to, any medium throughwhich users or entities share content, such as but not limited, texts,images (including videos), audio, files, links, feeds, streamingcontent, or any other type of digital content, or any other type ofpersonal or professional information related to the users or entities.

In another example, the users may allow an institution to track theuser's locations through a location determining device (e.g., GPS, orother like device) in a user's mobile device when entering atransaction, and thus, identify the location of users when entering thetransaction. In other embodiments of the invention, the locationdetermining device may be a Wi-Fi triangulation, or the like that can beused to determine the location of the user when the user is utilizing aWi-Fi connection though a mobile device. For example, the user's mobiledevice may have a specific address when utilizing a Wi-Fi connection andthe location of the user may be determined by identifying the address ofthe mobile device and the Wi-Fi network on which the user device isoperating, such as on a Wi-Fi hot spot at an entry, or other likelocation.

In other embodiments of the invention electronic data captured fromelectronic receipts or actual receipts may be used as a source ofactivity information. In the online purchase context, various electroniccommunications may be provided to the customer from the merchantrelative to a purchase. For example, following an online purchase, themerchant may provide the customer an electronic order confirmationcommunication. The order confirmation may be sent to the customer'scomputer and displayed in a web browser application. The web browserapplication typically allows the customer to print a hard copy of theorder confirmation and to save the confirmation electronically. Themerchant will also typically send an email containing the orderconfirmation to the customer's designated email account. The orderconfirmation is essentially an e-receipt for the online purchase. Theorder confirmation includes detailed information regarding the productsor services purchased. For example, in the case of a product, the orderconfirmation may include stock keeping unit “SKU” code level data, aswell as other parameters, such as order number, order date, productdescription, product name, product quantity, product price, productimage, hyperlink to the product image on merchant website, sales tax,shipping cost, order total, billing address, shipping company, shippingaddress, estimated shipping date, estimated delivery date, trackingnumber, and the like. The order confirmation also includes informationabout the merchant, such as name, address, phone number, web address,and the like. For most online transactions, the merchant will send atleast one second communication confirming shipment of the order. Theorder shipment confirmation is typically also sent via email to thecustomer and typically includes the same information as the orderconfirmation, and in addition, shipping date, tracking number, and otherrelevant information regarding the order and shipment parameters.

Many merchants now also provide e-receipts to customers shopping atbrick and mortar locations. In general, at the point of sale, thecustomer may have previously configured or may be asked at the time ofsale as to whether she wishes to receive an e-receipt. By selecting thisoption, the merchant will send an electronic communication in the formof an e-receipt to the customer's designated email address. Here again,the e-receipt will typically include a list of services and/or productspurchased with SKU level data, and other parameters, as well asinformation about the merchant, such as name, address, phone number,store number, web address, and the like.

Various merchants now also provide online customer accounts for repeatcustomers. These online customer accounts may include purchase historyinformation associated with the customer accessible by the customer viaID and passcode entry. Purchase history provides detailed informationabout services and products purchased by the customer includinginformation found on order confirmations and shipping confirmations foreach purchase. Online customer accounts are not limited to onlinepurchases. Many merchants also provide online customer accounts forcustomers that purchase products at brick and mortar locations and thenstore these transactions in the customer's online account.

For the most part, order confirmations, shipping confirmations,e-receipts, and other electronic communications between merchants andcustomers are used only by the customer as proof of purchase and formonitoring receipt of purchased items (i.e., for archival purposes).However, there is significant data that can be gleaned from thiselectronic information for the benefit of the customer, so that thecustomer may have detailed information regarding purchase history,spending, and the like.

The general concept is to retrieve such electronic communications fromthe user or the entity, parse the data in these electroniccommunications for activity information, and associate the activityinformation from the electronic communications with the correspondingactivities. Therefore, the user may allow the institution to access theuser's e-mail account, entity accounts, or stored e-receipts in order toaccess information related to electronic communication for atransaction, or otherwise allow the entity to send the e-receipts to theinstitution directly. The financial and social management system 1 maybe able to identify activity information in the e-receipts related tothe specific products and associated individual costs within thetransaction, a time associated with the transaction, as well as theactual location associated with the transaction (e.g., location of show,concert, or game for which tickets were purchased, or the like), orother activity information described herein.

In the context of an online purchase, the electronic communications maytake the form of purchase order confirmations provided as a web page oras an email or as both. In some, embodiments, the merchant computingsystem may provide a web page purchase order confirmation, and advisethe customer to either print, electronically save, or book mark theconfirmation web page. The purchase order confirmation is essentially ane-receipt for the online purchase transaction. The order confirmationincludes detailed information regarding the products or servicespurchased, such as for example, in the case of a product, SKU code leveldata, as well as other parameters associated with the product, such astype/category, size, color, and the like, as well purchase priceinformation, information associated with the merchant, and the like. Themerchant computing system may also send other subsequent communications,such as communications confirming shipment of the order, which typicallyincludes the same information as the purchase order confirmation, and inaddition, shipping date, tracking number, and other relevant informationregarding the order. In the context of an in-store purchase, themerchant computing system may send an e-receipt comprising informationsimilar to that of the purchase order confirmation. In some instances,the customer may actually receive a paper receipt, which the customermay choose to scan into an electronic form and save in a storage device.In the description herein, the term e-receipt may be used generically torefer to any communication or document provided by a merchant to acustomer relating to a purchase transaction.

As is understood, once the purchase transaction data has been extracted,various information regarding a particular purchase transaction is nowknown, such as merchant name, merchant web address, order number, orderdate, product description, product name, product quantity, productprice, product image, hyperlink to the product image on merchantwebsite, sales tax, shipping cost, order total, billing address,shipping company, shipping address, estimated shipping date, estimateddelivery date, tracking number, and the like. This data can be used toenrich the activities that are described in further detail herein.

As illustrated by block 106, the financial and social management system1 may determine activity information for the one or more activitiesrelated to the location of the one or more transactions, based at leastin part on the sources of information accessed. For example, aspreviously discussed the financial and social management system 1 maydetermine the location of the user at the same or similar time at whichthe user participated in one or more activities based on the user'smobile device, based on the time and date at which the user indicatedhe/she was located within a social networking account, based on ane-receipt, or other like information.

Block 108 of FIG. 1 illustrates that the financial and social managementsystem 1 may determine activity information for the one or moreactivities related to social relationships the user may have with otherusers for the one or more activities. For example, as explained infurther detail later a first user 4 may be identified as being locatedat an entity at a particular point in time (e.g., through the use of themobile device with the location determining device, or other locationdetermination such as social networking location indications). Thefinancial and social management system 1 may identify all of the otherusers (e.g., second user 6, third user, fourth user, or the like) thatmade transactions or were located at or near the location of the entityat the same or similar time as the first user 4. As such, the financialand social management system 1 may access the first user's socialnetworking account to determine if the other users are listed ascontacts (e.g., friends, followers, family, co-workers, or the like)within the social networking accounts, in order to determine the otherusers (e.g., the second user 6, the third user, or the like) that may beassociated with the activity at the entity. In other embodiments, thefinancial and social management system 1 may identify users that weretagged at the same or similar locations, or in images taken or uploadedat the same time as the activity in order to determine other users toassociate with the activity. In this way, the financial and socialmanagement system 1 may determine the other users to associate (e.g.,tag) with the one or more activities.

Block 110 of FIG. 1 illustrates that the financial and social managementsystem 1 determines activity information from the sources of informationfor the one or more activities related to the one or more entities. Forexample, a purchase may be made with an entity (e.g., restaurant 1), butthe transaction information includes the name of the parent company ofthe entity (e.g., holding company 1). In order to provide entityinformation, the financial and social management system 1 may utilizee-receipts, entity names from social networking accounts, locationinformation of the user, and Internet information related to the entityassociated with the location, or the like. In this way the financial andsocial management system 1 may identify specific information about anentity when the information is not already included in the originaltransaction information.

As illustrated by block 112 in FIG. 1, the financial and socialmanagement system 1 determines activity information from the sources ofinformation for the one or more activities related to one or morecategories for the one or more activities. For example, e-receipts mayprovide category information for the products or services related to theuser's one or more activities. In other embodiments, the user's socialnetworking information, such as the locations at which the userindicates that he/she is located provides category information relatedto the entity and/or the products provided by the entity. For example,the user may indicate within a social networking account that he waslocated at an entity and the institution may determine a categoryassociated with the entity (e.g., the entity may be certified within thesocial networking site and also listed as part of a category). In otherembodiments category information may be determined by utilizing publiclyavailable information regarding category information from the Internet.For example, the financial and social management system 1 may determinethat the user is located at entity 1 and search the Internet todetermine that entity 1 is listed as being a part of a coffee shopcategory (e.g., through a category code, website of the entity, or thelike).

As illustrated by block 114 in FIG. 1, the financial and socialmanagement system 1 identifies images (e.g., icons, digital photographs,avatars, logos, or the like) that are related to an entity or a userassociated with an activity, or the activity in general. For example,the financial and social management system 1 may access profilepictures, avatars, or other images associated with other users throughthe contacts a user has within the user's social networking accounts.Moreover, the financial and social management system 1 may also accesspublic information (e.g., images on the Internet) to identify logos,photos, or other images associated with an entity for the one or moreactivities. Moreover, images may also be captured from e-receipts thatare identified, for example in the user's e-mail accounts, from directaccounts with the entities, or other like accounts. In otherembodiments, images may be captured from the user's mobile device, suchas through the stored images on a user's mobile device.

As illustrated by block 116 in FIG. 1, the financial and socialmanagement system 1 receives an indication from the user to access thefinancial and social management application 15. In response, thefinancial and social management system 1 authenticates the user. Block118 of FIG. 1 illustrates that the financial and social managementsystem 1 displays one or more of the financial and social managementinterfaces described herein, such as the financial and social managementoverview interface 200, the activity list interface 500, activitylocation interface 700, activity social relationship interface 800 (orother like filtered activity list interface), package overview interface1000, package image interface 1100, package transaction interface 1200,package social relationship interface 1300, an activity historyinterface 1600, activity review overview interface 1800, consumptioninterface 1900, or other like interfaces.

FIG. 2 illustrates one embodiment of the financial and social managementoverview interface 200. The financial and social management overviewinterface 200 may display a navigation bar that allows users to navigatethrough the financial and social management application 15. Thenavigation bar may include an activity selection 202 that allows theuser to access activity lists, a package selection 204 that allows theuser to access packages, a history selection 206 that allows user toview activity history and activity review interfaces, a deals selection208 for offers (e.g., coupons, discounts, or the like) for products, orother like selection links. The financial and social management overviewinterface 200 may also include an activity list section 210, a packagesection 220, past activity section 230, or other like sections, whichprovide users an overview of activities and allows them to scrollthrough various activity lists, packages, or past activities.

As illustrated in the activity list section 210 the user may be able toview the activities associated with all of the user's accounts 212. Thismay include accounts that are located with other secondary financialinstitutions, to which the user may allow the primary financialinstitution to access in order to consolidate financial transactioninformation from multiple financial institutions into a singleapplication. In other embodiments, the financial and social managementapplication 15 may be hosted by a third party institution that is not afinancial institution, but which consolidates account information frommultiple accounts across multiple financial institutions. The activitylist section 210 may also allow the user to view activities based onindividual accounts (e.g., checking, savings, investment, equity line,or any other type of account involving the transfer of products,currency, or equivalent values) within a single institution or acrossmultiple institutions.

As illustrated by the package section 220 the user may scroll throughvarious packages that have been automatically created, or createdmanually by the user, in order to group the user's activities. Thepackages in the package section 220 may be displayed as packagesummaries 222 that include activity images, such as photographs, logos,or other like images, which relate to the activities in the packages.The package summaries 222 may also illustrate activity informationassociated with the activities in the packages, such as dates,locations, total money spent, or the like.

As illustrated by the past activity section 230 the user may scrollthrough various activities that the user may have engaged in overspecific days, or other time periods in the past. The activities may bedisplayed as activity summaries 232 that include activity images andactivity information as was described with respect to the packagesection 220. The activity lists, packages, and activity histories, aswell as the associated interfaces will be explained in further detailbelow.

FIG. 3 illustrates an image integration process 300 for an activity listin accordance with one embodiment of the invention. As illustrated byblock 302 in FIG. 3 the financial and social management system 1receives an indication that the user (e.g., first user 4) participatedin one or more activities. This may include transactions for productswith an entity, transfers from other financial institutions, depositsfrom other users (e.g. within or outside of the financial institution),transactions with other users, or any other type of transaction that auser may enter.

As illustrated by block 304, the financial and social management system1 identifies activity information for one or more of the activities. Forexample, as previously described the activity information may be adeposit of a check in the first user's account from another user (e.g.,second user 4) and the identified activity information may be theidentity of the second user 6. For example, the identity of the seconduser 6 may be determined from the information captured from an image ofthe check (e.g., scanned check, photo of the check, or the like). Thename of the user on the check may be read from the image of the check.Alternatively, the transfer may be an electronic transfer from thesecond user 6 and the user's identity may be transferred electronicallyalong with the amount of the transfer. In other embodiments of theinvention the activity may be a transaction for a specific product or atransaction with a specific entity. The identified activity informationmay be the name of the product or the name of the specific entity (e.g.,merchant, other user, or the like) that is determined from thetransaction information sent to the institution after the user entersthe transaction with the entity. In other embodiments, the product orentity may be identified through e-receipts, a social networkingaccount, or other means as described throughout the specificationherein.

As illustrated by block 306 in FIG. 3, the financial and socialmanagement system 1 identifies one or more images associated with one ormore users for one or more activities. In the example of the checkdeposited by a first user 2 from a second 6 user in the first user'saccount, the financial and social management system 1 may access thefirst user's social networking accounts and search for contacts thatmatch the identity of the second user 6 (e.g., using the name of thesecond user 6 identified from the check or other type of transaction).If a second user 6 is identified as a contact in the first user's socialnetworking accounts, then the financial and social management system 1may automatically use the image associated with the second user 6 (e.g.,profile picture, or the like) as an image for the activity of thedeposited check. In other embodiments of the invention the financial andsocial management system 1 may identify images of the second user 6tagged in the first user's photos within the social networking accountand utilize the photos or portions of the photos as the image associatedwith the activity (e.g., the deposited check transaction). In stillother embodiments, the financial and social management system 1 mayperform an image analysis of the profile picture to determine if theimage is a picture of the second user 6, instead of a picture of anotherperson, an animal, an object, scenery, or the like. The financial andsocial management system 1 may also compare multiple photographs toidentify an accurate image of the second user 6, for example, makingsure that the images tagged as the second user 6 are consistent witheach other. Moreover, in some embodiments the financial and socialmanagement system 1 may prompt the first user 1 to select an image ofthe second user 6 or confirm that an image determined automatically isin fact the second user 6. Selection of an image for the second user 6may also occur when there are multiple users with the same identitywithin the contacts of the first user's social networking accounts. Insome embodiments of the invention contacts may also be identifiedthrough the user's contact lists in the user's e-mail accounts, contactslists in the user's mobile devices, or other contact lists. In additionto capturing images associated with the contacts in the contact lists,other activity information about the contacts from the contact lists mayalso be utilized by the financial and social management system 1 (e.g.,used to tag other users as explained in further detail later).

Block 308 of FIG. 3 illustrates that one or more images from an activitywith an entity (e.g., merchant) are also identified. For example, thefinancial and social management system 1 may search the Internet for animage related to a merchant, such as a logo of the merchant on themerchant website, or an image of the merchant store captured from theInternet or the social networking account of the first user 4. In someembodiments, the user may have identified the merchant (e.g., follows,likes, is a fan of, or is otherwise is associated with the merchant) inthe user's social networking accounts and the images may be determinedfrom a social networking page of the merchant. In other embodiments ofthe invention, an image (e.g., logo, picture of store, or the like)associated with the merchant may be stored within the financial andsocial management system 1, for example, by the financial institutionsystems 10 as discussed in further detail later. In other embodimentsthe user's photos in the user's mobile device may be used as an imagefor the merchant (e.g., photo taken at the same or similar time as thetransaction). Again, the user may be prompted by the financial andsocial management system 1 with one or more images associated with themerchant before the image is associated with the activity and displayedin the activity list interface 500, as discussed in further detaillater.

As illustrated by block 310 in FIG. 3, the financial and socialmanagement system 1 may also identify one or more images associated witha product involved in an activity. The image for the product may bedetermined by the financial and social management system 1 from a searchof the Internet for an image related to the product, such as a logo ofthe product from a website related to the product, or an image of theproduct captured from the Internet or from a social networking accountof the user. In some embodiments, the user may have identified theproduct (e.g., follows, likes, is a fan of, or is otherwise associatedwith the product) in the user's social networking accounts and theimages may be determined from a social networking page associated withthe product. In other embodiments of the invention, an image (e.g.,logo, picture of the product, or the like) associated with the productmay be stored within the financial and social management system 1, forexample, by the financial institution systems 10 as discussed in furtherdetail later. In other embodiments the user's photos in the user'smobile device may be used as an image for the product (e.g., photo takenat the same or similar time as the transaction). Again, the user may beprompted by the financial and social management system 1 with one ormore images associated with the product before the image is associatedwith the activity and displayed in the activity list interface 500.

In still other embodiments of the invention, as illustrated by block312, other images may be associated with the activity, such as but notlimited to category images, location images, or personal images capturedby the user. For example, with respect to category images, if a usermakes a purchase for coffee and an image for the coffee merchant is notavailable (e.g., coffee merchant does not allow use of the image, coffeemerchant does not have an image on the Internet, no image in the user'ssocial networking account is available, or the like) a category imagemay be associated with the activity. The category image may be a generalicon that is used for food and beverages, or more specifically coffeeshops (e.g., an image of coffee beans, a cup of coffee or the like).With respect to location images, an image of the city, or otherlocation, in which the user made the purchase may be used in associationwith the activity. In some embodiments of the invention a photo of thecity (or other location) in which a user entered a transaction may beused instead of an image of the user, product, merchant, or the like.Personal images may also be associated with an activity instead of or inaddition to a user, product, merchant, or other like image. For example,instead of using a logo for a merchant, the financial and socialmanagement system 1 may capture an image taken at the same or similartime as the transaction from a social networking account of the user,and utilize the image with the activity (e.g., utilize a familyphotograph at restaurant 1 from social media instead of the logo of therestaurant.)

In some embodiments of the invention the financial and social managementsystem 1 may capture images from the first user's social networkingaccounts or mobile phone that were taken, uploaded, or the like, at thesame or similar time as the time stamp of the transitions, or that mayotherwise reference the activity. Images may be taken by a mobiledevice, camera, or other device that include not only a time stampassociated with the image, but also a location stamp (e.g., GPS stamp ofthe picture) associated with the image. For example, if a user makes apurchase with entity 1, takes a picture of the purchase, and uploads thepicture to a social networking site, the financial and social managementsystem 1 may identify the photo as being related to the purchase throughthe stored or uploaded photo containing location stamp. For example, ifthe location stamp of the photo and the location of the activity matchedthe photo may be associated with the activity. In other embodiments ofthe invention, if the photo is time stamped, the timestamp of the photomay be compared with the transaction time and associated with theactivity if the transaction times are same or similar (e.g., within aspecific range). For example, if the transaction time of the purchaseand the uploaded photo occurred within, for example, 10 minutes of eachother, the financial and social management system 1 may identify thatthe photo should be linked with the purchase in the first user'saccount. In other embodiments, if the photo was taken or uploadedoutside of the time period of the activity, but the social networkingaccount specifically referenced the name of the store, product, orlocation in the description of the picture, the photo may also beassociated with the activity.

As illustrated by block 314, the financial and social management system1 displays an activity list with the one or more activities, theassociated activity information, and the associated one or more imagesin the interfaces, as described throughout this specification.

It should be understood that in some embodiments of the invention anyimages determined for an activity may be stored and utilized again inthe future without having to identify the image again. For example, alogo of a restaurant is captured and approved by the user the first timethe activity occurs, and all subsequent transactions with the restaurantwill use the same image. However, in some embodiments, financial andsocial management system 1 may determine images for each activity asthey occur in the event that the images related to the activities changeover time. For example, images are determined for each activity in orderto make sure an image of a product has not changed, a profile picture ofa user has not changed, or the like.

As previously discussed herein other types of images may be associatedwith an activity in an activity list, such as card art from the usersinvolved in the transaction, check art from the checks involved in thetransaction, or other personalized data of the users associated with atransaction. For example, check art associated with a deposit of a checkfrom user 2 in an account of user 1 may be associated and displayed withthe activity of the deposit of the check in the account of user 1.

In still other embodiments of the invention the user may request thatspecific images be associated with a transaction on a one time,permanent, or semi-permanent basis. For example, the user may requestthat images for a location, user, entity, category, or period of timefrom public sources may be associated with an activity. The user mayselect an image from the Internet, from the user's camera roll on amobile device, or like, and the image may be associated with theactivity.

In still other embodiments of the invention images from an e-receiptsmay be associated with an activity when the financial and socialmanagement system 1 has identified an e-receipt that is related to anactivity. The images used may come from the e-receipt, a link providedin the e-receipt, or the like.

In addition, the financial and social management system 1 may also beable to identify the browsing history of user and use the browsinghistory to associate additional activity information and images with anactivity. For example, right before a user made a purchase the financialand social management system 1 may identify that the user was searchingfor a product or entity over the Internet. As such, the financial andsocial management system 1 may be able to associate images from thebrowser history (or other activity information) at the time of theactivity or just before the time of the activity with the activity thatthe user subsequently entered into or previously entered into at thesame or similar time. For example, the user may have searched for TVsand within the next five minutes made a purchase of a TV. Therefore, animage of the TV in the user's browser may be associated with theactivity related to a large purchase that occurred at the same orsimilar time as the time of the browser history of the user.

In some embodiments of the invention, images may also be captured fromthe wish lists of users, which can be compared to activities in order tocapture images from the wish list and associate the images with theactivities in the financial and social management system 1.

In addition to the various ways of capturing images, which have beendescribed above, activities may be tagged with activity information inthe same or similar way that has been described with respect toassociating images with activities, which is described in further detailbelow.

FIG. 4 illustrates a tagged relationship process 400, in accordance withone embodiment of the invention. As illustrated by block 402 in FIG. 4the financial and social management system 1 receives an indication thatthe user (e.g., first user 4) participated in one or more activities. Aspreviously discussed the activities may be any number of different typesof transactions associated with a user's financial accounts.

As illustrated by block 404 of FIG. 4, the financial and socialmanagement system 1 accesses activity information related to thelocation and time of the one or more activities. This occurs in a sameor similar way as was previously discussed with respect to capturingactivity information and images for the activity list described in FIG.3. For example, the location and time of an activity in some embodimentsmay be provided in transaction information that a merchant sends to aninstitution to complete a transaction. However, in some embodiments thetransaction information may not include one or more of the location,date, and time information, or this information may otherwise fail to becorrect or have enough specificity. Therefore, in other embodiments, thefinancial and social management system 1 may utilize a locationdetermining device in a mobile device of the user (e.g., first user 4)to capture the approximate location and time of a transaction in whichthe user first user 4 entered. In still other embodiments of theinvention the user (e.g., first user 4) may allow access to the user'ssocial networking accounts, such that the financial and socialmanagement system 1 may access the first user's social networkingaccounts in order to identify locations, times, images, and other likeinformation related to an activity of the user. For example, if a firstuser 4 entered into a transaction with an entity that did not providelocation information (e.g., food truck that travels around to differentareas), and the first user 4 also used a social networking account toindicate that the user was located at a specific area when making thepurchase, the financial and social management system 1 may supplementthe transaction information received from the merchant with otheractivity information identified using the first user's social networkingaccounts (e.g., the purchase related to the food truck was made at aspecific location).

In other embodiments of the invention a user's calendar (e.g.,electronic calendar) may be utilized to identify the location of theuser during an activity, as well as other users associated with theactivity, or other general information about the activity. For example,if the user entered a transaction at 1 pm, the financial and socialmanagement system 1 may access the user's calendar to identify that theuser was having lunch at noon with two other people, and then associatethe location of the lunch (e.g., restaurant 1) and the other users(e.g., second user 6 and a third user) from the calendar informationwith the activity (e.g., the purchase made at 1 pm). The calendar mayalso be used to identify images that may be associated with theactivity, as previously described with respect to FIG. 3.

As illustrated by block 406 of FIG. 4, after identifying the location,date, and time that a first user 4 participated in one or moreactivities, the financial and social management system 1 may identifyand tag one or more users (e.g., a second user 6) as being associatedwith one or more of the first user's activities in a social relationshiptag (e.g. user tag). As previously described, the financial and socialmanagement system 1 may automatically determine the users to tag byidentifying other users located at the same or similar location as thefirst user 4 at the same or similar time as the activity of the firstuser 4. The location of the other users is determined in the same way asdescribed with respect to the first user 4, such as through thetransaction information in which the other users were engaged, thelocation determining devices (e.g., GPS) of the other users, the socialnetworking accounts of the other users, e-mail accounts, or the like.The financial and social management system 1 may then identify if theother users are contacts of the first user 4 through either the firstuser's social networking accounts or the other user's social networkingaccounts. If the other users are contacts and are also located at thesame location as the first user 4 at the time of an activity associatedwith the first user 4 or the other users, then it is likely that thefirst user 4 and the other users are associated. As a result thefinancial and social management system 1 may automatically tag the oneor more other users as being associated with the first user's activity,or otherwise present a proposed user tag to the first user 4 foracceptance or denial of the user tag. In other embodiments of theinvention the financial and social management system may simply identifythat a first user 4 entered an activity at a particular time orlocation, and identify other users in the social networking accounts ofthe first user that were tagged at the same location and time, oridentified in images taken or uploaded at the same location and time,and associate the other users with the activity of the first user 4.

As illustrated by block 408, the financial and social management system1 identifies and tags one or more locations associated with the one ormore activities. The locations for a particular activity may change orvary based on the type of activity. For example, when purchasing food ata restaurant or a product at a particular store, the location of theactivity is likely the restaurant or the location of the store. Thislocation as previously discussed with respect to block 404 may bedetermined using the transaction information sent to the institution,social networking account information, using a location determiningdevice in the user's mobile phone, or the like.

In some embodiments of the invention, some merchants do not includelocation information in the transaction information, the socialnetworking information may not be available, the location determiningdevice may not be active, or the location may not be related to thelocation of the purchase. For example, when purchases are made forproducts over the Internet that are later delivered to the customer, orwhen purchases are made for future events or products, the location tagfor the transaction may be different than the location of the purchase.With respect to purchases made over the Internet, the entity associatedwith the activity may be located hundreds or thousands of miles awayfrom the user entering the transaction. As such, the location associatedwith the activity may be more appropriately described as the shippingaddress, or purchase address, and not the location of the entity. Forexample, a first user 4 may make three purchases over the Internet withentity 1 from the first user's primary residence. One purchase may befor the first user 4 and it is shipped to the first user's primaryresidence, and as such either the addresses associated with the account(e.g., primary residence) or the shipping address may be the taggedlocation of the activity. The second purchase may be for the first user4 and it is shipped to the first user's vacation home, and as such theshipping address should be identified as the tagged location. The thirdpurchase may be a gift for family or friends and it is shipped to alocation unrelated to the first user 4, and as such, the first user'sprimary residence may be the tagged location. In order to determine thecorrect location tag for which to tag the activity, the first user 4 mayallow the financial and social management system 1 to access the user'se-mail accounts, or other types of accounts, in order to accesse-receipts from the user. The financial and social management system 1may identify information from the e-receipts that indicates the primaryresidence location, shipping location, the name associated with theaddress (e.g., could indicate whether or not the purchase was a gift),and other like information. In other embodiments of the invention, atthe time of purchase, or at another point in time, the user mayauthorize that the entity involved in the activity may automaticallysend an electronic receipt of the activity information (e.g.,transaction information) to the institution associated with the accountthat the user is utilizing to participate in the activity.

As illustrated by block 410 in FIG. 4, the financial and socialmanagement system 1 identifies and tags one or more entities associatedwith the one or more activities. This information may be determined whenthe user makes a purchase and the entity sends the transactioninformation, including the name of the entity, to the financialinstitution. For example, a fast food chain restaurant may provide theentity name to the financial institution along with the cost of thepurchase. However, in some embodiments some entities may be groupedunder a parent company, or otherwise may use a name unaffiliated withthe actual entity, for example some restaurants may be grouped under aholding company. As such, the name of an entity included in thetransaction information may be the holding or parent company and not theparticular entity for which the activity relates. In some embodiments ofthe invention, the entity tag may be determined by comparing thelocation of the user, based on a location determining device of theuser's mobile device or other location determination, with the entity atthe location of the user at the time of the activity (e.g., through theInternet). As also previously discussed, the entity may also bedetermined from social networking accounts of the user, e-receipts,accounts with the entity itself, or other like accounts for which theuser has allowed the financial and social management system 1 access.The financial and social management system 1 can determine the entityfor a transaction by accessing one or more of the user's accounts withthe user's permission.

As illustrated by block 412 in FIG. 4, the financial and socialmanagement system 1 identifies and tags one or more categoriesassociated with the one or more activities. Categories for products orentities may be identified in a number of ways including entity andproduct codes, such as but not limited to merchant category codes (MCC),stock keeping units (SKU), bar codes, QR codes, universal product codes(UPC), or any other type of codes. The product or category codes may beincluded in the activity information transmitted between the entity andthe institution for the activity. The entity or product codes may alsobe included in e-receipts sent to the user or institution, and thus,extracted from the e-receipts as previously described herein. In otherembodiments of the invention the financial and social management system1 may determine categories for products or entities by identifying theentity or product, as previously described herein, and associating theentity or product with a category through stored categories, searchingthe Internet for categories, or other like means. Moreover, in someembodiments of the invention the financial and social management system1 may access a user's social networking account to identify a product orentity that was liked, followed, or otherwise identified by the userthrough a tag, description, or the like in the user's social networkingaccount at the same or similar time as the activity and associate acategory with the activity based on the product or entity.

As illustrated by block 414 in FIG. 4 an activity list 510 is displayedto the user in an activity list interface 500 (or other interface) asillustrated in FIG. 5 described below. As illustrated by block 416 thefinancial and social management system 1 may receive an indication fromthe user (e.g., first user 4) to update the activity list by adding,deleting, or editing one or more tags associated with the one or moreactivities. In one embodiment, proposed tags are presented to the userfor user acceptance before the tags are added to the one or moreactivities. Furthermore, the user may be able to opt in or out of thetagging features of the financial and social management system 1.

In some embodiments of the invention, software may be utilized toidentify people, locations, landmarks, products, entities, or the likewithin images in the social networking accounts of the users, storeddatabases, the Internet, or other sources of information, in order tohelp to determine activity information related to activities or imagesto associate with the activities. For example, facial recognitionsoftware may be used to identify users in images (e.g., in theforeground or background of the image) that might be associated with anactivity in order to tag the user as being associated with the activity.In another example, a landmark, landscape, text (e.g., sign, caption, orthe like), or other like feature within the image may be used todetermine a location, entity, or category tag to associate with theactivity.

FIG. 5 illustrates an activity list interface 500, in accordance with anembodiment of the invention. As illustrated in the activity listinterface 500 the navigation bar indicates that the activity list isbeing displayed in the interface. The activity list interface 500 mayinclude an account selection 502, such as a menu, link, drop-downselection, or the like to allow the user to switch between displayingthe activities for all accounts, a single account, or multiple accountsacross multiple institutions. The activity list interface 500 may alsoinclude a calendar selection 504 that illustrates the activity list incalendar form.

The activity list interface 500 may include an activity list 510 that issorted based on the day of the transaction. The activity list 510 mayalso include an account identifier 512 illustrating the institutionname, institution image, or account number indicating the accountassociated with the activity. As illustrated in the activity list 510multiple accounts from multiple institutions may be provided in theactivity list interface 500. For example, the user may allow thefinancial and social management system 1 to access accounts at otherfinancial institutions and include activities for the accounts at theother financial institutions in the activity list 510 (e.g., Bank 1,Bank 2, or the like).

The activity list 510 may also include an entity identifier 514illustrating the entity image, entity name, or entity number indicatingthe entity associated with the activity. As illustrated in the activitylist 510 the entity may be different merchants or users engaged invarious activities (e.g., transactions, deposited checks, moneytransfers, account transfers, account credits or debits, or the like).The activity list may also include activity information captured fromvarious sources, such as an entity name 516, activity category 518,activity time 520, activity location 522, activity cost 524, or otherlike activity information.

In some embodiments of the invention the activity list 510 may alsoinclude an activity tag section 530, which may be expanded or hidden inthe activity list. Within the activity tag section 530 the tags may beautomatically or manually added to the activity as previously discussedwith respect to FIG. 4 and elsewhere throughout this specification. Asillustrated the tags may include user tags 532, location tags 534,entity tags 536, and category tags 538. In other embodiments of theinvention, other tags may be included, such as but not limited to timeof day tags (morning, afternoon, evening, late night, or the like). Asillustrated in the activity tag section 530 the user may also have theability to connect additional accounts 542, view packages 544 in whichthe activity is located, edit images 546 associated with the activity,and edit tags 548 in order to add, delete, or change tags.

As further illustrated in the activity list 510, the activities may bebroken down into individual products within a products section 570 ofthe activity list 510. The products section 570 may be expanded orhidden as desired by the user. Typically only a total cost of anactivity is transmitted between an entity with which a user entered atransaction and the financial institution with which the user's accountis located. Therefore, the institution often does not have a list of theproducts associated with the activity. As previously discussed the usermay allow the institution to access the user's accounts, such as but notlimited to, e-mail accounts, entity accounts, social networkingaccounts, or the like in order to allow the financial and socialmanagement system 1 to determine a list of products associated with anactivity (e.g., through e-receipts, past orders within an entityaccount, references to products in social networking accounts at thesame or similar time as the activity, or the like). Individual productswithin the products section 570 may have images, as well as tags oflocations, categories, entities, or the like associated with theindividual products within the activity. For example, a TV and cable maybe purchased through entity 1, however, entity 1 is only a distributorand the TV is actually produced by entity 5, while the cables areproduced by entity 6. As such not only is the activity tagged withentity 1, but the actual products within the activity may be tagged withentity 5 and entity 6 respectfully.

FIG. 6 illustrates an activity filter process 600, in accordance with anembodiment of the invention. As illustrated by block 602 of FIG. 6, thefinancial and social management system 1 receives an indication of oneor more activities in which a first user participated, and tags the oneor more activities with location, user, entity, category, or other liketags associated with one or more of the activities, as previouslydescribed with respect to FIG. 4.

As illustrated by block 604 of FIG. 6, the financial and socialmanagement system 1 receives an indication from a user (e.g., first user4) to filter activities by location and display the filtered activitiesin an activity location interface 700 as illustrated in FIG. 7. Theactivity location interface 700 may include a navigation bar, a locationimage section 710, a relationship section 720 (e.g., location map, orthe like), and an activity list section 730. A location header 702 mayalso be provided in the activity location interface 700, whichidentifies the location of the one or more activities.

The location image section 710 may include a photograph of the city,area, section of a city, or other like location that is related to theone or more activities. The image may be determined as previouslydescribed with respect to FIG. 3, or another like means. The locationimage section 710, or another section within the activity locationinterface 700 may include an activity summary 712 illustrating the totalamount spent at the location, date range associated with the locationactivities, or other activity information related to the activities atthe location.

With respect to the relationship section 720 of the activity locationinterface 700, the relationship section 720 may be a location mapillustrating the locations of the activities on a map. The map may beinteractive and may include markers 722 (e.g., pins, flags, pointers, orthe like) that not only indicate the location of the activity, but alsomay provide activity information, such as but not limited to, theproducts purchased, the costs, the date and time of the activity, thename of the entity, or the like. The activity information may beidentified by rolling over or selecting the one or more markers. Inother embodiments of the invention, the relationship section 720 mayinclude other activity information, such as amounts spent for groupedtime periods, users, entities, categories, or the like within thespecified location.

With respect to the activity list section 730, the activity list isfiltered to only display activities within the one or more selectedlocations, but may have the same information as previously describedwith respect to the activity list interface 500 illustrated in FIG. 5.

As illustrated by block 606 of FIG. 6, the financial and socialmanagement system 1 receives an indication from a user (e.g., first user4) to filter activities by one or more users and display the filteredactivities in an activity social relationship interface 800 asillustrated in FIG. 8. The activity social relationship interface 800may comprise a navigation bar, a social relationship image section 810,a relationship section 820 (e.g., word block, location map, or thelike), and an activity list section 830. A social relationship header802 may also be provided in the social relationship interface 800illustrating the one or more users included in the social relationshipinterface 800. As illustrated in the social relationship header 802 ofFIG. 8, only activities associated with a single user (e.g., USER 2) aredisplayed, however, the first user 4 may also filter the socialrelationship interface 800 based on groups of two or more users. Assuch, the social relationship header 802 may include the names of morethan one user.

The social relationship image section 810 may include one or morephotographs, or other type of image, associated with the one or moreusers. The images may be determined and included in the socialrelationship image section 810 as previously described with respect toFIG. 3. The social relationship image section 810, or another sectionwithin the social relationship interface 800 may include an activitysummary 812 illustrating the total amount spent with one or more users,date ranges for the activities associated with the one or more users, orother activity information related to the activities associated with theone or more users included in the social relationship interface 800.

With respect to the relationship section 820 of the social relationshipinterface 800, the relationship section 820 may be a word map asillustrated in FIG. 8. The word map may illustrate the most importantcategories for the activities associated with the users. In otherembodiments of the invention the relationship section 820 may be asummary of the largest purchases, most purchases, categories ofpurchases, or the like with the one or more other users, and theassociated amounts spent with respect to each. In other embodiments therelationship section 820 may be a location map illustrating locations ofthe activities on a map that are associated with one or more otherusers. As described with respect to FIG. 7, the location map may beinteractive and may include markers (e.g., pins, flags, pointers, or thelike), which not only indicate the location of the activity, but alsomay provide activity information such as the products purchased, thecosts, the date and time of the activity, the name of the entity, or thelike. The activity information may be identified by rolling over orselecting the one or more markers.

With respect to the activity list section 830 the activity list isfiltered to only display activities associated with one or more users,but may have the same information as previously described with respectto the activity list interface 500 illustrated in FIG. 5.

As illustrated by block 608 of FIG. 6, the financial and socialmanagement system 1 receives an indication from a user to filteractivities by one or more entities and display the filtered activitiesin an activity entity interface. The activity entity interface is notdisplayed herein, but may be the same as or similar to the locationactivity interface 700 and the social relationship interface 800 asillustrated and described with respect to FIGS. 7 and 8. The activityentity interface may include an entity image section providing imagesassociated with the entity as previously described herein. The activityentity interface may also include a relationship section providingactivity information in a location map illustrating the location oftransactions associated with the entity. Activity information may alsobe displayed in a relationship section through the use of word maps,categories of products with the associated amounts spent for thecategories, or the like. The activity entity interface may also includean activity list filtered to only display activities associated with oneor more entities, but the activity list may have the same or similarinformation as previously described with respect to the activity listinterface 500 illustrated in FIG. 5.

As illustrated by block 610 of FIG. 6, the financial and socialmanagement system 1 receives an indication from a first user 4 to filteractivities by one or more categories and display the filtered activitiesin an activity category interface. The activity category interface isnot displayed herein, but may be the same as or similar to the locationactivity interface 700 and the social relationship interface 800 asillustrated in and described with respect to FIGS. 7 and 8. The activitycategory interface may include a category image section providing imagesassociated with a product, category of products, services, category ofservices, or the like as previously described herein with respect toFIG. 3. The activity category interface may include a relationshipsection providing activity information displayed through the use of oneor more categories with associated amounts spent within each of the oneor more categories. In other embodiments the relationship section mayprovide activity information in a location map illustrating the locationof activities associated with the category. The activity categoryinterface may also include an activity list filtered to only displayactivities associated with one or more categories, but the activity listmay have the same or similar information as previously described withrespect to the activity list interface 500 illustrated in FIG. 5.

As illustrated by block 612 of FIG. 6, the financial and socialmanagement system 1 displays the one or more interfaces from block 604through 610 to the user automatically or upon request by the user. Asillustrated by block 614 of FIG. 6, the financial and social managementsystem 1 receives an indication from the user to update the filteredactivity lists in one or more of the filtered interfaces from block 604through 610. As was previously discussed with respect to respect to thetagged relationship process 400 illustrated in FIG. 4 and the activitylist interface 500 illustrated in FIG. 5, the user may add, remove, oredit the activities or the tags in the filtered activity listsillustrated in the various interfaces.

In other embodiments of the invention the activities may be filteredbased on the expenses (e.g., costs for a purchase) associated with anactivity or the time at which the activities occurred during the day(e.g., morning, afternoon, night, a specific hour, or the like). Assuch, the user may request to filter the activities based on purchasesthat fall within a cost range of the activities. In some embodiments theactivities may be filtered using a combination of the activityinformation. For example, the user may request to filter all activitiesrelated to purchases at restaurants (e.g., category filter), whichoccurred during lunch time (e.g., time of day filter), and were in therange of $10 to $20 (e.g., cost filter). This allows the user to viewall of the activities that the user made and the associated images,users, categories, locations, and entities for the activities that meetthe user's filters in order to identify spending habits and allow theuser to adjust spending.

FIG. 9 illustrates a past package process flow, in accordance with anembodiment of the invention. As illustrated by block 902 of FIG. 9 thefinancial and social management system 1 receives an indication that afirst user participated in one or more activities over a period of timeor for a particular location.

As illustrated by block 904 of FIG. 9, the financial and socialmanagement system 1 accesses activity information related to thelocation and/or time of the one or more activities. The location andtime may be determined as previously discussed herein, such as but notlimited to the transaction information between the entity and the user,a location determining device in the user's mobile phone or otherdevice, the social networking accounts of the user, e-receipts, or thelike.

As illustrated in block 906 of FIG. 9, the financial and socialmanagement system 1 groups the one or more activities into activitypackages based on the activity location and/or time period informationautomatically or manually. The time period may be determinedautomatically based in part on the activity information associated withthe location, users, entities, or categories related to the one or moreactivities. For example, the financial and social management system 1identifies that the user has participated in one or more activities incity 1 by identifying that the user has entered into transactions withinthe location of city 1. Furthermore, the financial and social managementsystem 1 may determine a time period for the package by identifyingtransactions before and after any transactions in the location of city 1and limiting the time period to the first and last transactions made inthe location of city 1 (or any other transactions on the same day, orthe like). The financial and social management system 1 may alsoidentify activities that occurred outside of the time period that may beincluded in the package. For example, if the package is a trip, thefinancial and social management system 1 may identify the cost of theflights associated with the package using e-receipts, or other meansdescribed herein, and add the entity and costs of the flights to thepackage. In other embodiments of the invention, the financial and socialmanagement system 1 may identify that the user made a number ofpurchases the day before arriving in city 1, such as for example at gasstations and a hotel that may be identified as travel costs associatedwith the trip, and thus, the financial and social management system 1may add these purchases to the package even though the purchases werenot made in the location (e.g., city 1) associated with the package.

As illustrated by block 908 of FIG. 9, the financial and socialmanagement system 1 accesses one or more of the user's social networkingaccounts and identifies images associated with one or more of theactivities in the packages as previously described herein with respectto FIG. 3. For example, the financial and social management system 1 mayidentify images posted on social networking accounts of the user eitherat the same time or at the same location as the time period and locationof the package or the one or more activates in the package. As such,images posted within the time period at the location associated with thepackage (e.g., photos uploaded during the trip), images tagged as beingassociated with the location outside of the time period of the package(e.g., photos uploaded after returning from the trip), or images postedat the same or similar time as activates outside of the location andtime period that are added later (e.g., photos of the user at the timeof the flight before the trip, photos of the user at locations on theway to the location, or the like) may be determined and/or added topackage automatically or manually.

Block 910 of FIG. 9 illustrates that the financial and social managementsystem 1 may access a first user's social networking accounts toidentify one or more other users associated with the one or moreactivities or the package, as previously described in FIG. 4 withrespect to identifying and tagging users. In some embodiments this maycomprise allowing the financial and social management system 1 to accessthe first user's 4 social networking accounts, and thereafter, thefinancial and social management system 1 determines contacts that weretagged or otherwise associated with the first user 4 during the sametime period or location that is covered by the package. In someembodiments, however, a first user 4 may associate (e.g., tag) anotheruser in a social networking account without the other user being presentat the activity, and as such the financial and social management system1 may identify users that should not be associated with a particularpackage. Therefore, in some embodiments, if a second user 6 is tagged ina photo in the first user's social networking accounts within the timeperiod or location of the package, but the second user 6 has not enteredinto transactions within the location or time period of the package,then the second user 6 may not be included in the package.

In other embodiments, as illustrated by block 912, the financial andsocial management system 1 may identify one or more other users (e.g.,second user 6) associated with one or more activities in the package.For example, the financial and social management system 1 may identifytransactions made by other users at the same or similar time as thefirst user 4 at the same or similar location. Then the financial andsocial management system 1 may access the first user's social networkingaccounts to identify if these other users (e.g., a second user 6) arecontacts with the first user 4 in the first user's social networkingaccounts, and as such, may be identified as being associated with thefirst user 4 in the package. The other users (e.g., second user 6) maythen be associated with (e.g., tagged, or the like) the package or theone or more activities within the package.

As illustrated by block 914, the financial and social management system1 may receive an indication from the first user to access the financialand social management application 15, and the financial and socialmanagement system 1 authenticates the first user 4. As illustrated byblock 916, the financial and social management system 1 displays the oneor more packages to the user containing the grouped activities, taggedusers, and associated images. In some embodiments, as illustrated byblock 918, the financial and social management system 1 may receive anindication from the user to update the one or more packages oractivities within the packages by adding, removing, or editing theactivities, tagged users, or images for the individual activities or thepackages in general.

In other embodiments of the invention, instead of, or in addition tobeing automatically created, the packages may be manually created. Forexample, the user may select a date range for a package, a location forthe package, activities to include in the package, or users to add tothe package, in order to create a package or supplement an automaticallycreated package.

FIG. 10 illustrates a package overview interface 1000, in accordancewith an embodiment of the invention. The package overview interface 1000may include a list of packages summaries 1010 (e.g., first package 1002,second package 1004, third package 1006, or the like). A package summary1010 may include for example, a package name 1012, package date 1014,package location 1016, package cost 1018, package activities 1020 (e.g.,transactions with entities and associated costs of the one or moretransactions within the package), and package images 1022 (e.g., photos,icons, logos, or the like). The package summary 1010, in someembodiments may also include one or more users associated with theactivities in the package (e.g., tagged, or the like), or one or morecategories associated with the activities in the package. Additionaldetails about the package may be viewed by selecting on one of thepackage summaries 1010.

FIG. 11 illustrates a package image interface 1100, in accordance withan embodiment of the invention. The package image interface 1100comprises a package name header 1102, a package map section 1110, and apackage information section 1120. The package name header 1102 providesthe name of the package. The package map section 1110 may include alocation map illustrating the locations of the activities in the packageon a map. The map located in the package map section 1110 may beinteractive, and may include markers 1112 (e.g., pins, flags, pointers,or the like) that not only indicate the locations of the activities, butalso may provide activity information such as the products purchased,the costs of the products, the date and time of the activities, the nameof the entities associated with the activities, users associated withthe activities, or the like. The activity information may be identifiedby rolling over or selecting the one or more markers 1112. The packagemap section 1110, or another section, may also comprise a packageinformation section 1114 illustrating the package cost (e.g., the totalcost of the activities in the package), and a package date (e.g., dateranges of the activities), or other like information.

The package information section 1120 may include an image tab 1122, anactivity list tab 1124, and a user tab 1126. As illustrated in FIG. 11,when the image tab 1122 is selected the one or more images associatedwith the package are displayed. As illustrated in FIG. 12, when theactivity list tab 1124 is selected an activity list 510 is displayed, aswas previously described with respect to the activity list interface 500illustrated in FIG. 5. As illustrated by FIG. 13, when the user tab 1126is selected the users associated with the package are displayed alongwith images of the users as previously discussed with respect to theimage integration process 300 in FIG. 3 and the activity list interface500 in FIG. 5.

FIG. 14 illustrates a proposed package process 1400, in accordance withan embodiment of the invention. As illustrated by block 1402, thefinancial and social management system 1 receives an indication that theuser would like to set up a package for one or more activities. Theindication may include one or more time periods, or one or morelocations associated with the package. For example, a first user 4 mayselect a weekend for a trip and a location for the trip.

As illustrated by block 1404, the financial and social management system1 may receive an indication from a user to set up a budget for thepackage of one or more activities on the trip. For example, a first user4 may set a budget of $2,000 for the trip.

Block 1406 of FIG. 14 illustrates that the financial and socialmanagement system 1 receives and indication from a user to allocatefunds from one or more user accounts to the package. For example, afirst user 4 may allocate $500 from a savings account, $500 from achecking account, $500 from an investment account, and the last $500 maybe selected as having to be saved for the trip.

As illustrated by block 1408 the user may group one or more pastactivities into the package. For example, a first user 4 may indicatethat the plane ticket has been already purchased for a cost of $500, andassign the activity of the plane ticket and the associated cost to thepackage created. In other embodiments of the invention, the assignmentof activities to the package may be performed automatically by thefinancial and social management system 1 (e.g., plane ticket isautomatically associated based on the location activity information).Furthermore, as illustrated by block 1408 the user may also add proposedfuture activities to the package. For example, the first user 4 may havebooked a hotel for the trip for $250 a night for two nights, but theuser's account is not charged until the stay at the hotel is completed.As such, the first user 4 may assign the cost of the hotel to thepackage as a future activity expense in order to budget for the package.In other embodiments of the invention the future cost may be assigned tothe package automatically by the financial and social management system1.

Block 1410 illustrates that the financial and social management system 1receives an indication to associate one or more users with the packageor with activities in the package. For example, the first user 4 mayidentify and tag users from previous activities within the first user'sfinancial accounts. The first user 4 may also tag other users byselecting various users from the first user's social networkingaccounts. The financial and social management system 1 may also accessthe social networking accounts of the first user 4 to automatically taguser's associated with the package or the one or more activities in thepackage as previously described with respect to the tagged relationshipprocess 400 of FIG. 4. The financial and social management system 1 mayaccess the social networking accounts of the first user 4 to accessimages for the tagged users as previously described with respect to theimage integration process 300 of FIG. 3, the tagged relationship process400 of FIG. 4, and the activity list interface of FIG. 5.

In other embodiments of the invention, the financial and socialmanagement system 1 may access the first user's e-mail accounts, phonecontact list, or other accounts to identify contacts, or otherwisereceive e-receipts for activities or proposed activities, in order totag users in the package. For example, the financial and socialmanagement system 1 may identify in an e-receipt for the flightassociated with the package that the flight includes a second user 6,and thus, the financial and social management system 1 tags the seconduser 6 within the package. Moreover, as previously discussed thefinancial and social management system 1 may identify users to tag inthe package as previously discussed with respect to the taggedrelationship process 400 of FIG. 4 and the activity list interface ofFIG. 5. That is, in one embodiment the financial and social managementsystem 1 may identify users that are contacts with each other throughthe social networking accounts of the users, and also identify thatusers made similar purchases at the same or similar times and/orlocations. For example, the financial and social management system 1identifies that the first user 4 and the second user 6 are contacts, andboth the first user 4 and the second user 6 have purchased the sameflight to the same place. This information may be available to thefinancial and social management system 1 because both users may use thesame financial institution, provide information from multiple financialinstitution accounts, allow access to e-receipts sent between the firstuser 4 and the second user 4 in the e-mail accounts of the users, or thelike.

As illustrated by block 1412, the financial and social management system1 receives an indication to associate one or more images with thepackage or with the one or more activities in the package. For example,as previously described herein with respect to the image integrationprocess 300 of FIG. 3, images may be associated with proposed activitieswithin the package. For example, the airline logo may be attached to theproposed flight activity in the package based on images captured frome-receipts from the airline, over the Internet, from the user's socialnetworking accounts, from stored images in the financial institution, orthe like. Furthermore, images of the identified location of the trip maybe included in the package from various sources, for example, byretrieving images from the Internet, from e-receipts in e-mail accounts,from social networking accounts, or the like. Moreover, if the packagehas the same location, or has the same or similar activities as pastpackages or activities, images from the past packages or activities maybe incorporated into the proposed package.

Block 1414 illustrates that the financial and social management system 1receives an indication from the user to add, remove, or edit one or moreusers, images, activities, tagged activity information, or other likeinformation within the packages.

As illustrated in block 1416 the financial and social management system1 may add links to one or more activities within the packages. Forexample, a link to the first user's flight status may be included in thepackage in order to allow the user check the status of the flight as thetrip approaches. The user may allow the links to be added by allowingthe financial and social management system 1 to access an e-receipt orother linked information included in the first user's e-mail account, orother account (e.g., an account with the specific entity). In anotherexample, the financial and social management system 1 may identifyactivities purchased before the trip, such as tickets to a game, andprovide linked information in the package regarding the game (e.g.,website of the team, directions from the hotel to the game, or thelike). In some embodiments, the financial and social management system 1may provide links for activities that are not yet included in thepackage in order to provide suggested offers for activities in which toparticipate while at or near the location associated with the package.

As illustrated by block 1418, the financial and social management system1 may share the one or more packages with other users that may beinvolved with the trip. For example, a group of people may be involvedin planning the trip and paying for aspects of the trip, and as such,the packages (but not the user's financial account information) may beshared with various users to budget and pay for the trip associated withthe package. Multiple users may be able to add, delete, and editinformation within the package in order to plan for a trip or otherevent (e.g., saving for a purchase, or the like). In some embodiments ofthe invention payments may be collected or disbursed from or to theusers in the package by pulling or pushing funds between the financialaccounts of the users within the package.

In some embodiments of the invention the packages, and in particular thepast packages, may be exported to another file type, printed out, or thelike, in order to create an expense report for a business trip, to sharethe activities with budgeting software, or to share the activities withother users (e.g., users on the trip, or the like).

In some embodiments of the invention the packages may be formed based ongroups within the social networking accounts of a user. For example, auser may be a part of a group within a social networking account, suchas a charity group, a fan group, alumni group, a group associated with aproduct, entity, user, or category, or another like group. The financialand social management system 1 may identify that one or more activitiesof the user may be associated with the group and information from thesocial networking group may be captured. For example, users within thegroup may be tagged as being associated with an activity. In otherembodiments, other activity information, images, or other digitalcontent may be captured from the group within the social networkingaccount and associated with an activity.

In some embodiments of the invention the social networking accounts of auser may be utilized to not only identify activities in the past (e.g.,past locations of the user) or current activities (e.g., currentlocations of the user), but may also have the ability to identify futureactivities (e.g., locations at which the user will be in the future). Tothe extent that a social networking account includes information aboutthe user in the future, the financial and social management system maybe able to capture the future information and associate this type ofactivity information with an activity, as previously described hereinwith respect to past or current activities of the user.

FIG. 15 illustrates an activity history process 1500, in accordance withan embodiment of the invention. As illustrated by block 1502, thefinancial and social management system 1 receives an indication toidentify activity history for one or more activities in the past basedon a past time period (e.g., over a date range, specific selected datein the past, automatically every month, six months, a year, or otherlike date or date range in the past). For example, the first user 4 mayrequest, or be provided automatically, a view of activities thatoccurred on a particular day in the past, such as on a user's birthdayor other day in the past.

As illustrated in block 1504 in FIG. 15, the financial and socialmanagement system 1 receives an indication to identify activity historyfor one or more activities that occurred at a particular location (e.g.,in a country, state, city, town, area within a city, area around aparticular radius, or the like) either automatically or based on inputfrom the user. For example, when a user enters a particular location,the financial and social management system 1 may automatically identifythe user's location and determine all of the activities that occurred inthe location in the past. In other embodiments, the user may select aparticular location for which to receive activity history.

Block 1506 in FIG. 15 illustrates that the financial and socialmanagement system 1 then identifies the one or more activities that meetthe past time period and/or the location request from block 1502 and1504. For example, the financial and social management system 1identifies all of the transactions that occurred exactly a year ago fromthe current day. In addition, or alternatively, the one or moreactivities may be limited by location, such as within a particular cityfor a time period of two weeks in the past.

As illustrated by block 1508, the financial and social management system1 displays the one or more activities that meet the activity historyalong with activity information related to the location, associatedusers, entities, or categories, as well as images as previouslydescribed herein. This information may be stored by the financialinstitution, however, in some embodiments it may be difficult to storeall of this information for all the activities of all of the users, andthus, instead of storing this information, the financial and socialmanagement system 1 may access this information again on an as neededbasis from the user's social networking accounts, the Internet, or thelike as previously described herein.

FIG. 16 illustrates an activity history interface 1600, in accordancewith an embodiment of the invention. The activity history interface 1600includes a date history section 1610 and a location history section1620. The date history section 1610 may include an image of one or moreactivities that occurred on a particular date in the past (e.g.,illustrated as one year ago). The image illustrated in the date historysection 1610 may be stored from the original activity, or otherwisedetermined as needed in the same or similar way as was previouslydescribed with respect to the image integration process 300 illustratedin FIG. 3. Activity information for the activity on the date in the pastmay be included in place of or along with the image. For example, theamount of the activity 1612, the location of the activity 1614, theusers associated with the activity 1616, or categories associated withthe activity 1618 may be associated with the image. The activityinformation, like the image, may have been stored by the institution, orotherwise may be determined as needed, as previously discussedthroughout the specification. The activity information may be includedalong with the image, or otherwise selection features (e.g., icons,links, or the like) may be provided that display the activityinformation when rolled over or selected by the user, as illustrated inFIG. 16.

The location history section 1620, may include an image of one or moreactivities that occurred at a particular location in which the user islocated (e.g., within 3 miles) or for which the user requested (e.g.,activities in city 1). The image illustrated in the location historysection 1610 may be stored from the original activity, or otherwisedetermined as needed in the same or similar way as was previouslydescribed with respect to the image integration process 300 illustratedin FIG. 3. Activity information may be included in place of or alongwith the image. For example, the amount of the activity 1622, thelocation of the activity 1624, the users associated with the activity1626, or categories associated with the activity 1628 may be associatedwith the image. The activity information may be included along with theimage, or otherwise selection features (e.g., icons, links, or the like)may be provided that display the activity information when rolled overor selected by the user, as illustrated in FIG. 16.

In some embodiments of the invention the financial and social managementsystem 1 may push, pull, share, export, or otherwise allow other usersto view or share at least some of the activity history with other userswithin or outside of the financial and social managements system 1. Theactivity history of the first user 4 may be sent to other users (e.g.,second user 6). For example, if a first user 4 went to dinner with asecond user 6 on the first user's birthday a year ago, a portion or allof the activity history related to the restaurant, images, users, amountspent, or other activity information may be made available to the seconduser 6 as a reminder of the activities of the first user 4 and seconduser 6 in the past.

In addition to sending activity history that may be shared betweenusers, sponsored offers (e.g., coupon, discount, rebate, pricereduction, or the like) may be sent to the first user and/or the otherusers associated with the activity history information. The financialand social management system may provide an offer to the first user 4 orthe second user 6 when the activity information is shared. For example,the restaurant at which the users were located may provide an offer tothe users through the financial and social management system 1 when itis determined that the users have not participated in any activities atthe restaurant in the last three months. The financial and socialmanagement system 1 may provide activity history related to theexperience of the users at the restaurant along with the offer in orderto provide a more personalized offer to the users.

FIG. 17 illustrates an activity review process 1700, in accordance withan embodiment of the invention. As illustrated by block 1702 in FIG. 17,the financial and social management system 1 identifies a time periodfor which to provide activity review information for one or moreactivities. The activity review information may be providedautomatically or based on input from a user. For example, the financialand social management system 1 may automatically provide activity reviewinformation for the previous year, or the user may request activityreview information for the last six months. In other embodiments of theinvention any time period may be used or selected (e.g., previous 5years, 2 years, 1 year, 10 months, 6 months, 3 months, or the like).

As illustrated by block 1704, the financial and social management system1 may identify the activity information to aggregate over the timeperiod automatically, or based on input from a user. For example, thefinancial and social management system 1 may automatically identify thefirst user's largest purchase over the past year, the user with whichthe first user 4 spent the most money, the one or more categories forwhich the first user 4 spent the most money, or the like. In otherembodiments of the invention the user may select the activityinformation to aggregate. For example, the first user 4 may select thathe would like to view how much money he spent when he was with thesecond user 6, his largest purchase, the five categories for which thefirst user 4 spent the most money, or any other like activity reviewinformation. Block 1706 of FIG. 17 illustrates that the financial andsocial management system 1 aggregates the activity information for theone or more activities over the time period based on the location,social relationships, entities, and/or categories. In other embodimentsthe user may identify a set of aggregated activity information that isinteresting, such as by liking, giving a thumbs up, or otherwiseapproving the aggregated information. As such, the financial and socialmanagement system may identify preferences for aggregating specificactivity information for a user or a group of users based on thefeedback regarding the aggregated information from various users overtime.

As illustrated in Block 1708 of FIG. 17, the financial and socialmanagement system 1 supplements the aggregated activity information witheducational information (e.g., consumption data) regarding the one ormore activities. For example, consumption data may identify that theamount of gas purchased by the first user 4 over the span of year may beenough to drive between city 1 and city 2 five times. The educationalinformation may help users to allocate and budget the user's spendinghabits.

Block 1710 of FIG. 17 illustrates that the financial and socialmanagement system 1 displays the aggregated activity information and/oreducational information (e.g., consumption data, and the like) to theuser in an activity review interface 1800 as illustrated in FIG. 18. Theactivity review interface 1800 may include one or more expense summarysections 1810 illustrating the expense associated with activities (e.g.,the most expensive purchases for the first user 4). The activity reviewinterface 1800 may also include one or more category sections 1820illustrating the categories of entities, specific entities, categoriesof products, or specific products that are associated with activities ofthe user (e.g., coffee shops are where the first user 4 participates inthe most activities). The activity review interface 1800 may alsoinclude a time section 1830 illustrating the percentage of transactionsduring a specific time within a day, week, month, or the like for acategory, location, user, entity, or the like (e.g., X percent oftransactions occur between 11 pm and 2 am. The activity review interface1800 may further include a social relationship section 1840 thatillustrates the users with which the first user 4 spends money, butwhich may also illustrate the category, location, time, or entityinformation for the activities as well (e.g., X percentage of the firstuser's activities associated with a second user 6 are made inrestaurants). The activity review interface 1800 may also illustrate theactivity information with consumption information such as but notlimited to a consumption information section 1850 that illustrates factsor educational information related to the aggregated activityinformation. For example, the user's gas purchases may be identified anda consumption metric may be applied to the activity to illustrate howfar the user has traveled (e.g., the first user's gas purchases couldhave allowed the first user 4 to drive between city 3 and city 4 fivetimes). In other embodiments, the distances traveled between purchasesmay be totaled and provided indicating how far the user travels from theuser's home to make purchases. In other examples, the amount of coffeeplants used to make all of the coffee the user has consumed may bedisplayed in a consumption information section 1850. The aggregatedactivity information may include category, location, user, entity, timeperiod, or other like information, alone or in combination with eachother for the user's activities over a period of time.

The sections illustrated in the activity review interface 1800 may beinteractive to allow a user to drill-down to additional aggregatedactivity information and consumption information. For example, asillustrated by the consumption interface 1900 in FIG. 19, the financialand social management system 1 may illustrate that based on theaggregated activity information a user drinks on average 3.2 cups ofcoffee a day which translates to 1,168 cups of coffee a year, whicheventually illustrates the number of coffee plants needed to produce the1,168 cups of coffee a year. Other information may be provided in theconsumption interface 1900, such as list of all of the users associatedwith the first user 4 and the associated amounts spent with each user,or any other type of aggregated activity information.

In some embodiments of the invention aggregated information and theassociated educational information (e.g., the consumption information)may be displayed using info-graphics that include images, video, clips,or other digital content that helps to illustrate the aggregatedactivity information.

In addition to embodiments of the invention described herein, thefinancial and social management system 1 may provide deals foractivities, packages, past activities, or the like. The deals may beprovided in the activity lists, packages, or past activity interfacesdescribed herein.

In some embodiments of the invention the financial and social managementsystem may allow a user to transfer information back to, or shareinformation with the social networking accounts of the user, based inpart on the activities in which the user participates. For example, theafter a user makes a purchase, and the identity of the product, entity,category, or user is identified from the various sources of information,the financial and social management system 1 may prompt the user if theuser would like to “like,” support, follow, or otherwise indicate thatthe user has a relationship with the product (e.g., likes the product),entity (e.g., follows or likes the entity), or user (add the user as acontact in the social networking account of the user). In otherexamples, the financial and social management system 1 may prompt theuser to determine if the user would like to write a review of a product,entity, location, or the like on site that may allow the user to reviewthese types of activities.

Embodiments of the invention are described herein as a financialinstitution incorporating information from a social networking account.In some embodiments, the interfaces described herein may be displayedthrough an online banking account controlled by the financialinstitution. In other embodiments of the invention a social networkinginstitution can incorporate information from the financial institutionaccounts. In some embodiments, the interfaces described herein may bedisplayed through the social networking accounts controlled by thesocial networking institution. In still other embodiments as previouslydiscussed, a third-party can incorporate information from the accountsof the user at financial institutions and social networking institutionsinto a financial and social management system 1 run by the third-partyinstitution.

FIG. 20 illustrates a financial and social management system 1, inaccordance with one embodiment of the invention. As illustrated in FIG.20, one or more financial institution systems 10 are operativelycoupled, via a network 2, to a first user computer system 20, socialnetworking systems 30, a second user computer system 40, entity computersystems 50, or other user computer systems or financial institutionsystems (not illustrated). In this way users can access the financialand social management application 15, as well as other financialapplications 17, in order to perform the actions previously describedherein. The financial institution systems 10 are illustrated in FIG. 20as a single system; however, the financial institution systems 10, maybe made up of one or more systems, databases, engines, applications,modules, or the like.

The network 2 may be a global area network (GAN), such as the Internet,a wide area network (WAN), a local area network (LAN), or any other typeof network or combination of networks. The network 2 may provide forwireline, wireless, or a combination of wireline and wirelesscommunication between devices on the network 2.

In some embodiments of the invention the first user 4 and the seconduser 6 (e.g., customers, clients, employees, agents, contractors, legalrepresentatives, or the like), or other users, may have access to thefinancial and social management application 15 for tracking and managinguser activities.

As illustrated in FIG. 20, the financial institution systems 10generally comprise a communication device 12, a processing device 14,and a memory device 16. The processing device 14 is operatively coupledto the communication device 12 and the memory device 16. As used herein,the term “processing device” generally includes circuitry used forimplementing the communication and/or logic functions of a particularsystem. For example, a processing device may include a digital signalprocessor device, a microprocessor device, and various analog-to-digitalconverters, digital-to-analog converters, and other support circuitsand/or combinations of the foregoing. Control and signal processingfunctions of the system are allocated between these processing devicesaccording to their respective capabilities. The processing device mayinclude functionality to operate one or more software programs based oncomputer-readable instructions thereof, which may be stored in a memorydevice.

The processing device 14 uses the communication device 12 to communicatewith the network 2 and other devices on the network 2, such as, but notlimited to, the first user computer system 20, the social networkingsystems 30, the second user computer system 30, and other user computersystems or financial institution systems (e.g., systems of a secondfinancial institution). As such, the communication device 12 generallycomprises a modem, server, or other device for communicating with otherdevices on the network 2.

As further illustrated in FIG. 20, the financial institution systems 10comprise computer-readable instructions 18 stored in the memory device16, which in one embodiment includes the computer-readable instructions18 of financial and social management application 15 or other financialapplications 17. In some embodiments, the memory device 16 includes adatastore 19 for storing data related to the financial institutionsystems 10, including, but not limited to, data created and/or used bythe financial and social management application 15 or other financialapplications 17.

As illustrated in FIG. 20, the first user 4 may access the financial andsocial management application 15 through a first user computer system20. The first user computer system 20 may be a desktop, laptop, tablet,mobile device (e.g., smartphone device, PDA, phone, or other like mobiledevice), or any other type of computer that generally comprises acommunication device 22, a processing device 24, and a memory device 26.The processing device 24 is operatively coupled to the communicationdevice 22, and the memory device 26. The processing device 24 uses thecommunication device 22 to communicate with the network 2 and otherdevices on the network 2, such as, but not limited to, the financialinstitution systems 10, social networking systems 30, the second usercomputer system 40, entity computer systems 50, and/or other systems. Assuch, the communication device 22 generally comprises a modem, server,or other device for communicating with other devices on the network 2and/or a keypad, keyboard, touch-screen, touchpad, microphone, mouse,joystick, other pointer device, button, soft key, and/or other inputdevice(s) for communicating with the first user 4.

As illustrated in FIG. 20, the first user computer system 20 may havecomputer-readable instructions 28 stored in the memory device 26, whichin one embodiment includes the computer-readable instructions 28 of aweb browser or application 27, or other like tool, that allows the firstuser 4 to access the financial and social management application 15, orthe other financial applications 15. In some embodiments, the memorydevice 26 includes a datastore 29 for storing data related to the firstuser computer system 20, including but not limited to data createdand/or used by the web browser or application 27.

As illustrated in FIG. 20, the social networking systems 30 generallycomprise a communication device 32, a processing device 34, and a memorydevice 36. The processing device 34 is operatively coupled to thecommunication device 32 and the memory device 36. The processing device34 uses the communication device 32 to communicate with the network 2and other devices on the network 2, such as, but not limited to, thefinancial institution systems 10, the first user computer system 20, thesecond user computer system 40, entity computer systems 50, other usersystems, and/or other financial institution systems. As such, thecommunication device 32 generally comprises a modem, server, or otherdevice for communicating with other devices on the network 2.

As further illustrated in FIG. 20, the social networking systems 30comprise computer-readable instructions 38 stored in the memory device36, which in one embodiment includes the computer-readable instructions38 of a social networking application 37, or other like tool, whichusers can use to access, or otherwise allow the financial institution(e.g., financial and social management application 15) to access, theusers' social networking accounts. In some embodiments, the memorydevice 36 includes a datastore 39 for storing data related to the socialnetworking systems 30, including but not limited to data created and/orused by the social networking application 37.

As further illustrated in FIG. 20, the second user computer system 40communicates with the network 2 and other devices on the network 2, suchas, but not limited to, the financial institution systems 10, the firstuser computer system 20, the social networking systems 30, the entitycomputer systems 50, and/or other user systems, other financialinstitution systems, or other types of systems. The second user computersystem 40, and other user computer systems, have the same or similardevices as described with respect to the first user computer systems 20,and as such operate in the same way as discussed with respect to thefirst user computer system 20.

FIG. 20 further illustrates that entity computer systems 50 communicatewith the network 2 and other devices on the network 2, such as, but notlimited to, the financial institution systems 10, the first usercomputer system 20, the social networking systems 30, the second usercomputer system 40, other user computer systems, other financialinstitution systems, and/or other systems. The entity computer systems50, have the same or similar devices as described with respect to thefinancial institution systems 10 and social networking systems 30, andas such, operate in the same way as discussed with respect to thefinancial institution systems 10 and social networking systems 30 (orthe user computer systems).

As previously indicated, in some embodiments of the invention thefinancial and social management application 15, may be locatedcompletely or partially on the financial institution systems 10, firstuser computer system 20, social networking systems 30, second usercomputer system 40, entity computer systems 50, other user systems,other financial institution systems, or other systems not specificallyillustrated or described with respect to FIG. 20. For example, a portionof the financial and social management application 15 may be stored onmobile device of the users, such as an application on user mobiledevices that allows the user to access information stored in thefinancial institution systems 10, the social networking systems 3, theentity computer systems 50, or information on other financialinstitution systems, or other like systems.

As will be appreciated by one of skill in the art in view of thisdisclosure, the present invention may be embodied as an apparatus (e.g.,a system, computer program product, and/or other device), a method, or acombination of the foregoing. Accordingly, embodiments of the presentinvention may take the form of an entirely hardware embodiment, anentirely software embodiment (including firmware, resident software,micro-code, etc.), or an embodiment combining software and hardwareaspects that may generally be referred to herein as a “system.”Furthermore, embodiments of the present invention may take the form of acomputer program product comprising a computer-usable storage mediumhaving computer-usable program code/computer-readable instructionsembodied in the medium.

Any suitable computer-usable or computer-readable medium may beutilized. The computer usable or computer readable medium may be, forexample but not limited to, an electronic, magnetic, optical,electromagnetic, infrared, or semiconductor system, apparatus, ordevice. More specific examples (a non-exhaustive list) of thecomputer-readable medium would include the following: an electricalconnection having one or more wires; a tangible medium such as aportable computer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a compact disc read-only memory (CD-ROM), or othertangible optical or magnetic storage device.

Computer program code/computer-readable instructions for carrying outoperations of embodiments of the present invention may be written in anobject oriented, scripted or unscripted programming language such asJava, Pearl, Smalltalk, C++ or the like. However, the computer programcode/computer-readable instructions for carrying out operations of theinvention may also be written in conventional procedural programminglanguages, such as the “C” programming language or similar programminglanguages.

Embodiments of the present invention described above, with reference toflowchart illustrations and/or block diagrams of methods or apparatuses(the term “apparatus” including systems and computer program products),will be understood to include that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a particular machine, such that the instructions, which executevia the processor of the computer or other programmable data processingapparatus, create mechanisms for implementing the functions/actsspecified in the flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in acomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer readablememory produce an article of manufacture including instructions, whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer orother programmable data processing apparatus to cause a series ofoperational steps to be performed on the computer or other programmableapparatus to produce a computer implemented process such that theinstructions, which execute on the computer or other programmableapparatus, provide steps for implementing the functions/acts specifiedin the flowchart and/or block diagram block or blocks. Alternatively,computer program implemented steps or acts may be combined with operatoror human implemented steps or acts in order to carry out an embodimentof the invention.

U.S. patent application Ser. No. 14/032,464 to Votaw, entitled“Financial and Social Management System,” U.S. patent application Ser.No. 14/032,537 to Votaw, entitled “Activity List Enhanced With ImagesFor a Financial and Social Management System,” U.S. patent applicationSer. No. 14/032,594 to Votaw, entitled “Activity List Tagged WithActivity Information For a Financial and Social Management System,” U.S.patent application Ser. No. 14/032,741 to Votaw, entitled “Linking Usersand Activities Through Transactions Through Activity Information in aFinancial and Social Management System,” U.S. patent application Ser.No. 14/032,602 to Votaw, entitled “Activity List Linked with Receiptsfor a Financial and Social Management System,” U.S. patent applicationSer. No. 14/032,686 to Votaw, entitled “Activity List Filters For aFinancial and Social Management System,” U.S. patent application Ser.No. 14/032,991 to Votaw, entitled “Past Packages For a Financial andSocial Management System,” U.S. patent application Ser. No. 14/033,024to Votaw, entitled “Proposed Packages For a Financial and SocialManagement System,” U.S. patent application Ser. No. 14/032,661 toVotaw, entitled “Grouped Packages For a Financial and Social ManagementSystem,” U.S. patent application Ser. No. 14/032,655 to Votaw, entitled“Activity History For a Financial and Social Management System,” andU.S. patent application Ser. No. 14/032,646 to Votaw, entitled“Interactive Map for Grouped Activities Within a Financial and SocialManagement System,” were all filed Sep. 20, 2013, and are all herebyincorporated by reference in their entirety.

Specific embodiments of the invention are described herein. Manymodifications and other embodiments of the invention set forth hereinwill come to mind to one skilled in the art to which the inventionpertains, having the benefit of the teachings presented in the foregoingdescriptions and the associated drawings. Therefore, it is to beunderstood that the invention is not to be limited to the specificembodiments disclosed and that modifications and other embodiments andcombinations of embodiments are intended to be included within the scopeof the appended claims. Although specific terms are employed herein,they are used in a generic and descriptive sense only and not forpurposes of limitation.

What is claimed is:
 1. A computer program product for providing anactivity review of a first user in an activity review interface based onaggregated activity information from one or more financial accounts andone or more social networking accounts, the computer program productcomprising at least one non-transitory computer-readable medium havingcomputer-readable program code portions embodied therein, thecomputer-readable program code portions comprising: an executableportion configured to receive an indication to identify and aggregateactivity information for activities over a time period, wherein theactivities are transactions made by the first user with one or morefinancial accounts and the activity information is financial accountinformation captured from the one or more financial accounts and issupplemented with social networking information captured from the one ormore social networking accounts; an executable portion configured toidentify the activities that meet the time period; an executable portionconfigured to aggregate the activity information for the activities,wherein aggregating the activity information comprises: aggregating theactivity information related to locations involved in the activities;aggregating the activity information related to social relationshipsinvolved in the activities, wherein the social relationships aredetermined by determining the locations and times of the transactionsfrom the one or more financial accounts of the first user; accessing theone or more social networking accounts of the first user; determiningother users associated with the locations and the times of thetransactions within the one or more social networking accounts; andassociating the other users with the activities of the first user;aggregating the activity information related to entities involved in theactivities; and aggregating the activity information related tocategories involved in the activities; and an executable portionconfigured to capture at least one location image associated with atleast one of the locations, wherein the at least one location image iscaptured by: accessing the one or more social networking accounts of thefirst user; capturing a location image from the one or more socialnetworking accounts, wherein the location image is associated with atleast one of the locations within the social networking account; anexecutable portion configured to capture at least one user image of atleast one of the other users associated with the social relationships,wherein the at least one user image is captured by: accessing the one ormore social networking accounts of the first user; capturing a userimage from the one or more social networking accounts, wherein the userimage is associated with at least one of the other users; and anexecutable portion configured to capture at least one entity imageassociated with at least one of the entities, wherein an entity image iscaptured from an electronic source; an executable portion configured tocapture at least one category image associated with at least one of thecategories, wherein a category image is captured from an electronicsource; and an executable portion configured to display the aggregatedactivity information for the activities related to the locations, thesocial relationships, the entities, and the categories in the activityreview interface along with the location image, the user image, theentity image, and the category image on a display of the first usercomputer system.
 2. The computer program product of claim 1, wherein thecomputer-readable program code portions comprise: an executable portionconfigured to supplement the aggregated activity information witheducational information related to the activities.
 3. The computerprogram product of claim 2, wherein the educational information isconsumption information related to the activities.
 4. The computerprogram product of claim 1, wherein the activity review interface is anintegrated interface comprising the activity information captured andcombined from the one or more financial accounts and one or more socialnetworking accounts of the first user, and images from the one or moresocial networking accounts, and websites.
 5. The computer programproduct of claim 1, wherein the executable portion configured toaggregate the activity information for the activities comprises:aggregating the activity based on a time of day of the activities. 6.The computer program product of claim 1, wherein the executable portionconfigured to receive the indication to identify and aggregate theactivity information for the activities over the past time periodcomprises: an executable portion configured to receive an indicationfrom the first user identifying the locations, the social relationships,the entities, and the categories to aggregate; and an executable portionconfigured to receive the time period from the first user over which toaggregate the activity information.
 7. A method for providing anactivity review of a first user in an activity review interface based onaggregated activity information from one or more financial accounts andone or more social networking accounts, the method comprising receiving,by one or more processing devices, an indication to identify andaggregate activity information for activities over a time period,wherein the activities are transactions made by the first user with oneor more financial accounts and the activity information is financialaccount information captured from the one or more financial accounts andis supplemented with social networking information captured from the oneor more social networking accounts; identifying, by the one or moreprocessing devices, the activities that meet the time period;aggregating, by the one or more processing devices, the activityinformation for the activities, wherein aggregating the activityinformation comprises: aggregating the activity information related tolocations involved in the activities; aggregating the activityinformation related to social relationships involved in the activities,wherein the social relationships are determined by determining thelocations and times of the transactions from the one or more financialaccounts of the first user; accessing the one or more social networkingaccounts of the first user; determining other users associated with thelocations and the times of the transactions within the one or moresocial networking accounts; and associating the other users with theactivities of the first user; aggregating the activity informationrelated to entities involved in the activities; and aggregating theactivity information related to categories involved in the activities;and capturing, by the one or more processing devices, at least onelocation image associated with at least one of the locations, whereinthe at least one location image is captured by: accessing the one ormore social networking accounts of the first user; capturing a locationimage from the one or more social networking accounts, wherein thelocation image is associated with at least one of the locations withinthe social networking account; capturing, by the one or more processingdevices, at least one user image of at least one of the other usersassociated with the social relationships, wherein the at least one userimage is captured by: accessing the one or more social networkingaccounts of the first user; capturing a user image from the one or moresocial networking accounts, wherein the user image is associated with atleast one of the other users; and capturing, by the one or moreprocessing devices, at least one entity image associated with at leastone of the entities, wherein an entity image is captured from anelectronic source; capturing, by the one or more processing devices, atleast one category image associated with at least one of the categories,wherein a category image is captured from an electronic source; anddisplaying, by the one or more processing devices, the aggregatedactivity information for the activities related to the locations, thesocial relationships, the entities, and the categories in the activityreview interface along with the location image, the user image, theentity image, and the category image on a display of the first usercomputer system.
 8. The method of claim 7, further comprising:supplementing, by the one or more processing devices, the aggregatedactivity information with educational information related to theactivities.
 9. The method of claim 7, wherein the educationalinformation is consumption information related to the activities. 10.The method of claim 7, wherein the activity review interface is anintegrated interface comprising the activity information captured andcombined from the one or more financial accounts and one or more socialnetworking accounts of the first user, and images from the one or moresocial networking accounts, and websites.
 11. The method of claim 7,wherein aggregating the activity information for the activitiescomprises: aggregating the activity based on a time of day of the one ormore activities.
 12. The method of claim 7, wherein receiving theindication to identify and aggregate the activity information for theactivities over the past time period comprises: receiving an indicationfrom the first user identifying the locations, the social relationships,the entities, and the categories to aggregate; and receiving the timeperiod from the first user over which to aggregate the activityinformation.